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RANDOM WALK AND THE THEORY OF BROWNIAN MOTION* 

MARK KAC,f Cornell University 


1. Introduction. In 1827 an English botanist, Robert Brown, noticed that 
small particles suspended in fluids perform peculiarly erratic movements. This 
phenomenon, which can also be observed in gases, is referred to as Brownian 
motion. Although it soon became clear that Brownian motion is an outward 
manifestation of the molecular motion postulated by the kinetic theory of mat- 
ter, it was not until 1905 that Albert Einstein first advanced a satisfactory 
theory. 

The theory was then considerably generalized and extended by the Polish 
physicist Marjan Smoluchowski, and further important contributions were 
made by Fokker, Planck, Burger, Fiirth, Ornstein, Uhlenbeck, Chandrasekhar, 
Kramers and others [l]. On the purely mathematical side various aspects of 
the theory were analyzed by Wiener, Kolomgoroff, Feller, Levy, Doob, and 
Fortet [2]. Einstein considered the case of th e free particle^ that is, a particle 
on which no forces other than those due to the molecules of the surrounding 
medium are acting. His results can be briefly summarized as follows. 

Consider the motion of the projection of the free particle} on a straight line 
which we shall call the #-axis. What one wants is the probability 



x ; t)dx 


that at time t the particle will be between xi and X 2 if it was at xo at time 2 = 0. 
Einstein was then able to show that the “probability density” P(x 0 | x; 2)§ must 
satisfy the partial differential equation 

dP d 2 P 

(1) = D , 

dt dx 2 


where D is a certain physical constant. The conditions imposed on P are 



(a) 

P ^ 0 


(2) 

(b) 

t-H 

II 

0 



(c) 

lim P{x 0 1 x; t) = 0, 

for x 5* xo. 


t-*o 


* This is an extended version of an address delivered at the annual meeting of the Association 
at Swarthmore, Pennsylvania, December 26-27, 1946. 

f John Simon Guggenheim Memorial Fellow. 

J In what follows we shall identify this projection with the particle itself and hence consider the 
so-called one-dimensional Brownian motion. 

§ The notation P(x 0 \x; t) and P(n\ nr, s ) for conditional probabilities is that used by Wang and 
Uhlenbeck [l]. It does not conform with the notation adopted in the statistical literature. Had we 
adopted the latter notation we would write P(x\ t\ # 0 ) and P(m; s\n). 
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Conditions (a) and ( b ) are the usual ones imposed upon a probability density 
and condition ( c ) expresses the certainty that at / = 0 the particle was at xq . 
It is well known that (1) and (2) imply that 

(3) P(x o | x; t ) = — = 

2\/ irDt 

and that the solution (3) is unique. 

The greatness of Einstein’s contribution was not, however, solely due to 
the derivation of (1), and hence (3). From the point of view of physical ap- 
plications it was equally, or perhaps even more, important that he was able to 
show that 


(4) 


2 RT 

D = > 

Nf 


where R is the universal gas constant, T the absolute temperature, N the 
Avogadro number, and /the friction coefficient. The friction coefficient/, in the 
case the medium is a liquid or a gas at ordinary pressure, can in turn be ex- 
pressed in terms of viscosity and the size of the particle [3]. 

It was relation (4) that made possible the determination of the Avogadro 
number from Brownian motion experiments, an achievement for which Perrin 
was awarded the Nobel prize in 1926. However, the derivation of (4) belongs 
to physics proper, and presents no particular mathematical interest ; we shall 
therefore not be concerned with it in the sequel. 

As soon as the theory for the free particle was established, a natural ques- 
tion arose as to how it should be modified in order to take into account outside 
forces as, for example, gravity. Assuming that the outside force acts in the 
direction of the #-axis and is given by an expression F(x ), Smoluchowski has 
shown that (1) should in this case be replaced by 


(5) 


dP 1 d d 2 P 

= (PF) +D 

dt f dx dx 2 


Two cases of special interest and importance are: 

F(x) = —a; field of constant force (for example, gravity). 

F(x) = — bx; elastically bound particle (for example, small pendulum). 

At this point it must be strongly emphasized that theories based on (1) and 
(5) are only approximate. They are valid only for relatively large t and, in the 
case of an elastically bound particle, only in the overdamped case, that is, when 
the friction coefficient is sufficiently large. These limitations of the theory were 
already recognized by Einstein and Smoluchowski but are often disregarded 
by writers who stress that in Brownian motion the velocity of the particle is 
infinite. This paradoxical conclusion is a result of stretching the theory beyond 
the bounds of its applicability. An improved theory (known as “exact”) was 
advanced by Uhlenbeck and Ornstein and by Kramers. The Uhlenbeck-Orn- 
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stein approach was further elaborated by Chandrasekhar and Doob. 

In what follows we shall be concerned with a discrete approach to the Ein- 
stein-Smoluchowski (approximate) theory. This approach was first suggested 
by Smoluchowski himself ; it consists in treating Brownian motion as a discrete 
random walk. Smoluchowski used this approach only in connection with a free 
particle but we shall also treat other classical cases. Moreover, a re-interpreta- 
tion of one of the discrete models will allow us to discuss the important question 
of recurrence and irreversibility in thermodynamics. 

The main advantages of a discrete approach are pedagogical, inasmuch as 
one is able to circumvent various conceptual difficulties inherent to the continu- 
ous approach. It is also not without a purely scientific interest and it is hoped 
that it may suggest various generalizations which will contribute to the develop- 
ment of the Calculus of Probability. 

2. The free particle. Imagine a particle which moves along the #-axis in such 
a way that in each step it can move either A to the right or A to the left, the du- 
ration of each step being r. The fact that we are dealing with a free particle is 
interpreted by assuming that the probabilities of moving to the right or to the 
left are equal, and hence each equal Instead of P(x 0 \x; t) we now consider 
P(nA\ mA\ sr) =P(»|m; s) which is the probability that the particle is at mA 
at time sr 9 if at the beginning it was at nA. Noticing that P(n\tn; s ) is also the 
probability that after 5 games of “heads or tails” the gain of a player is v = m — n, 
we can write 


(6) P{n | m;s) = 


5! 




if v ^ s and v + s is even, 


otherwise. 


Suppose now that A and r approach 0 in such a way that 

A 2 

(7) — = D, nA — > xo t st = t. 

2 T 


It then follows from the classical Laplace-De Moivre theorem [ 4 ] that 


( 8 ) 


lim 


1 C X2 

E P(n\m;s) = —— I *-<-■ 
Ly'KUtJ 






and hence the fundamental result of Einstein emerges as a consequence of what 
in probability theory we call a “limit theorem.” 

It is both important and instructive to point out a striking formal connec- 
tion between the discrete (random walk) and the continuous (Einstein) ap- 
proaches. We notice that P(n | m; s) satisfies the difference equation 

(9) P{n | nr, s + 1) = \P(n | m - 1; 5 ) + \P(n | m + 1; s), 
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which we write in the equivalent form 

P{nA | mA; (s + l)r) — P{nA | mA ; st) 


A 2 fP(nA | (m + 1)A; st) — 2P{nA | mA ;st) + P{nA | {m — 1)A; st) 
2r 1 A 2 ” 



In the limit (7) this difference equation goes over formally into the differential 
equation 


(ID 


dP d 2 P 

= D , 

dt dx 2 


which as noted before was the basis of Einstein’s theory. This formal connec- 
tion between the two approaches can be made rigorous, but we shall not go 
into this. However, we shall use it as a guiding heuristic principle in constructing 
models of Brownian motion when outside forces are taken into account. 

Finally, let us mention that it is the relation 


A 2 



which is responsible for the conclusion that the velocity of a Brownian particle 
is infinite. In fact, in our model, the ratio A/r plays the role of the instantaneous 
velocity and it obviously approaches infinity as A— >0. 

3. Particle in a field of constant force and in the presence of a reflecting 
barrier. We again consider random walk along the #-axis in which a particle can 
move A to the right or, A to the left, the duration of each step being r. We now 
introduce the following new assumptions: 

(a) The probability of a move to the right is q = j8A, and consequently the 
probability of a move to the left is p = J+/3A. Here fi is a certain physical con- 
stant, and A must be chosen sufficiently small so that g>0. 

(b) When the particle reaches the point # = 0 {reflecting barrier) it must, in 
the next step, move A to the right. 

Without the assumption (b) the problem would be quite simple and of no 
great physical interest. In actual experiments with heavy Brownian particles, 
like those of Perrin, the bottom of the container acts as a reflecting barrier and 
the elucidation of its influence on the Brownian motion is of considerable theo- 
retical interest. 

This problem has been solved by Smoluchowski, on the basis of his equa- 
tion (5) but we shall show that one can solve the discrete problem and obtain 
Smoluchowski ’s result by passing to a limit. 

Assuming that the particle starts from tzA^O {n an integer) we seek an ex- 
plicit expression for P{n\m ; s). We first notice that P{n\m; s) satisfies, for 
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2, the difference equation 

(12) P(n | m; s + 1) = qP(n | m — 1 ; s) + pP(n | m + 1 ; s), 
and that for m = l and m = 0 we have 

(12a) P(n | 1; s + 1) = P(n \ 0; s) + pP(n | 2; s), 

(12b) P(n j 0; i + 1) = pP(n | 1; s). 

We also have the initial condition 

(13) P{n | m; 0) = n ), 

where 5 (m, n) denotes, as usual, the Kronecker delta. 

The difference equation (12) when rewritten in the form analogous to (10) 
can be shown to go over formally (in the limit A— >0, r— >0, A 2 /2 t=D, nA — ># 0 > 
mA—>x, sr = t) into the differential equation 


(14) 


dP d 2 P dP 

= D + 4 &D , 

dt dx 2 dx 


which is of the form (5) with F(x) = — a= — 4/SZ^jT. 

To find P(n | m; s) we use a method which is basic in the study of the so-called 
Markoff chains, of which our problem is but a particular example, and which in 
its essentials goes back to Poincare [5]. Let ( p) 8 be the (infinite) vector 


(15) 


(P)s = 


~P{n | 0; *)" 
P(n \ 1; s) 
P(n \ 2; s) 


and A the infinite matrix 


(16) 


A = 


0 p 0 0 0 • • • 

1 0 p 0 0 • • • 

0 q 0 p 0 • • • 

0 0 q 0 p • • • 


Then, the difference equation (12), (12a) and (12&), can be written in the matrix 
form as 

(17) (p)'+i = A(p) s . 

Thus it follows immediately that 

(18) (/>). = A’{p) o, 
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where ( p)o is the vector 

0 
0 

(#)e = 

0 

1 being the nth component, the components being numbered from zero on. In- 
terpreting (18), we see that 

(19) P(n | m; s) = the ( m , n) element of A 8 . 

To make use of (19), we notice that if jR>w+s and we consider the finite matrix 
An , which is the upper left R by R submatrix of A, then for m <R 

(20) the ( m , n) element of A 8 = the ( m , n) element of A 
or equivalently, 

(21) the (w, n) element of A* = lim of the (w, n) element of A*r. 

R — > * 

For each R there exist matrices P R and Q R such that 

(22) P r Q r = I 

and 

~\o(R) 0 - 

Xi (R) 

(23) A r = P r • Q* 

_ o ‘ Xj8_i(je)_ 

X 0 (R), Xi (R)> • • , Xie_i(2?) being the eigenvalues of the matrix A R . To simplify 

the notation we write X,- for X/(-R). 

Multiplying the matrix Ar s times by itself and making use of (22), we ob- 
tain 



and one can calculate the (m, n) element of A% explicitly provided the diag- 
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onalization (23) can be performed explicitly. This indeed is the case. 

Let (#)o, (x) h • • • , (x) B—i be the “right” and ( y) 0f (y) i, • • •, the 

“left” eigenvectors belonging respectively to t;he eigenvalues Xo, Xi, • • • , Xb-i. 
In other words, for & = 0, 1, • • • , i? — 1, we have 

An(x) k = \k(x)k, 

Ait(y)k = Xfc(y)fc, 

where Ar is the transpose of A r . 

Suppose furthermore that the vectors can be so normalized that 

(25) (*)*•(?)*= 1, & = 0, 1, • • • , jR — 1, 

where (#)*• (y)k is the inner (dot) product of the vectors. Since it is well known 
that 

(#)?• (y)* = o for ^ 

we see that, in the case when all the eigenvalues are distinct, we can take as Pr 
the matrix whose columns are the vectors (#)* and for Qr the matrix whose rows 
are the vectors ( y)& . 

In order to determine the eigenvalues and the right eigenvectors we consider 
the system of linear equations 

px i = X#o 

£o + px 2 = \Xi 

(26) qx i + px 3 = \x 2 . 


qxR - 2 = \xr- i, 

and the extended infinite system 

px i = A#o 
^0 + px 2 = \xi 


(27) 


qxR-^i + pXR+i = \xr 


If we can find non-trivial solutions of (27), for which 
(28) x B = 0, 

we will have found solutions of (26). 

It turns out that (28) will yield an equation in X which has R distinct roots 
and thus our procedure gives us all eigenvalues, and consequently all right 
eigenvectors. Multiplying the members of the equations of (27) by 1, 
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z, z 2 , . . . , and adding, we obtain formally 


+ qYj XkZ k + l + p X XkZ 1 *- 1 = X X 


or, upon introducing the abbreviation, 


we have 


f(z) = X x k* k > 


+ qz[f(z) — Xo] H \f(z) - Xo\ = X/(z). 


From (30) we obtain 

p ( 1 - Xz ) 

(31) f(z) = — x 0 <- H — - — > , 

q { qz 2 — Xz + p) 

and since this function is analytic in the neighborhood of zero the formal pro- 
cedure used above can be justified. 

Let pi and p 2 be the reciprocals of the roots of 


qz 2 — Xz + p = 0. 


We have then 


P ( 

= — *o < — 


1 — Xz 


P( 1 - Piz)(l - P 2 Z) 


— P2Z)} ’ 


and introducing partial fractions, 


1 — Xz IX — pi 1 1 P 2 — X 1 

(34) = 1 , 

p{ 1 — PlZ) (1 — P2Z) p P 2 — Pi 1 — PiZ P P 2 — » Pi 1 — P2Z 


1 X — pi 


#o / X — 
q \P 2 — 


— Pi k P2 — * X 

Pi H P 2 

— Pi P 2 — * Pi ) 


for k^l, 


and, in particular, the equation ##=0 assumes the form 

X - Pi R P 2 — X R 

(36) Pi H p 2 = 0. 

P2 — Pl P2 — Pi 

Equation (36) must now be solved for X. Assuming R to be even, and seeking 
solutions in the form 


X = 2 yfpq cos 0, 


0 g 0 g x, 
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we are led to the equation 

tan R® 1 
tan ® 2p — 1 

For R>(2p — l)" 1 this equation is seen to have R — 2 distinct roots, 
®i, © 2 , • • • , © 22 - 2 , which lie in the subintervals 

( jir 7r jir 7r \ 

r~1r’ ~R + ~2r)’ 


where j ranges through the integers from 1 to R— 1 with the exception of j =R/2. 
Corresponding to ©i, © 2 , • • • , © 22-2 we have R — 2 distinct eigenvalues, 


\k = 2 \/pq cos ©*, k = 1, 2, • • • , R — 2, 

and the components of the right eigenvector belonging to X* can be written in 
the form 


where 


(m) 

Xk 


dk 



cos m® k — 2/3A 


sin m®k\ 
sin ©* / 



if m > 0, 

if p = 0, 


and a,k is a normalizing constant which will be fixed later. For sufficiently large 
R the remaining eigenvalues X 0 and \r-i can be shown to be given by the 
formulas 

Ao = 2 \fpq cosh 0 O , X 22 -i = — X 0| 


where 0 O is the only positive root of the equation 


tanh R9 1 


tanh 6 2p — 1 

The components of the corresponding right eigenvectors are given by the ex- 
pressions 

<m) / q \ ml2 ( sinh m6 0 \ 

xo = ao ( — ) [ cosh md 0 — 2£A ) 

\p /* \ sinh do I 

(m) m ( q \ m/2 / sinh md 0 \ 

xr—i = dR^ i(- 1) ( — ) ( cosh md 0 - 20A — — ). 

\p/* \ sinh 0 O / 

It remains now to find the left eigenvectors. This can be accomplished in exactly 
the same manner and we merely quote the results. We obtain 



378 


RANDOM WALK AND THE THEORY OF BROWNIAN MOTION [September, 


(mj , / p\ m ' i / sinw©A 

Jk = M — I I cosm®k — 2/3A — ) 

\q / \ sm @k / 

for m = 0, 1,... , R—l; k = l, 2, • • • , R — 2, and 

(m) , /P\ mli / , „ sinh mdo\ 

yo = bo ( — ) ( cosh md 0 — 2@A ) 

V q ) \ sinh do ) 

Cm) , . „ m/ p\ ml2 ( , sinh mdo\ 

yit-i = b B - 1(— 1) ( — ) ( cosh mdo — 2/3A ). 

\ q / \ smh do / 

To satisfy the normalization conditions (25) we must have 


(37) 

O-kbk 

Rzi 2 \ 

q+ EW 

m=l / 

= i, 

* - 1, 2, 2, 

(38) 

a,kbk 

2 \ 

? + X/ Fm(fio) ) 

m— 1 / 

= i, 

k = 0, R - 1, 

where 

/»(©) = 

sin ?w0 

cos w© — 2/3A 

sin 0 


and 

F m (d ) = 

cosh mO — 20A 

sinh md 



sinh 0 



We can, of course, put a 0 = ai= • ■ • =a B - i = l, and determine the b’s from (37) 
and (38). Referring back to (19), (20), and (24), and recalling that columns of 
Pr are the right eigenvectors (x) and the rows of Qr are the left eigenvectors 
(y)k, we obtain 

(39) P(n | m\ s) = X X*** m V*° . 

0 

or, more explicitly, 

n l 2 / a \ 

(7)* P m {do)F n {do) [l + (- l) ”*+’*+»] 
x ' / \ n / 2 / q \ m f 2 jB_ ' 2 

+ \g/ W* cos '’ ©*/.»(©*)/»(©*)• 

Making use of (21), we can achieve considerable simplification by letting 
2?— >oo . In fact, it can be shown that 

(41) P(n\m;s) = tlA V[l + (- l)”+” + *] 

2pq \p /* 


P{n nr, s) = b 0 (2\/pq cosh do) 3 
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+ 


2 / p \ nl 2 / q \ m/2 , /* 1 tan 2 © 

7(7) Vi)* i2VTqy Jo cos,0 '7~g) 2 '+17 2 "© / ’ i(0)/m(0)J@ 


Although in various places we have tacitly assumed that £ and g are different 
from §, the final formula (41) can easily be seen to be valid also for the case 
p = q = In this case (free particle in the presence of a reflecting barrier) the for- 
mula assumes the remarkably simple form 


(42) 


P(n\ m; s) = — (l) m/ * f 

7 r * •/ 0 


cos* 0 cos 7W0 cos w©d©, 


and the right member can be expressed in terms of binomial coefficients. This 
formula can also be derived in a much simpler way using, for instance, the classi- 
cal method of images. 

In the limit 


A 2 

A — » 0, r — » 0, — = D, nA — > Xoy st = /, 

2t 

one can show that 

/ : X2 

P(x 0 1 x\ t)dx , 

xi 


where 


2 r°° 

(43) P(xo\x;f) = ipe-w* + \ e~ D y h 

IT J 0 


f 


4/3 2 + f 


g(x,y)g(x 0 ,y)dy, 


and 


g(x , y) = cos xy — 2j8(sin xy)/y . 


The proof of this theorem is not elementary inasmuch as it utilizes the so called 
“continuity theorem for Fourier-Stieltjes transforms” [6]. Formula (43) can be 
shown to be equivalent with Smoluchowski’s formula given in [l]. 

4. An elastically bound particle. Again the particle can move either A to the 
right or A to the left, and the duration of each step is r. However, the probability 
of moving in either direction depends on the position of the particle. More pre- 
cisely, if the particle is at kA the probabilities of moving right or left are 


1 

~2 



or 


1 

2 



respectively. 2? is a certain integer, and possible positions of the particle are 
limited by the condition — R^k^R. The basic probabilities P(n\m\ s ) now 
satisfy the difference equation 



380 RANDOM WALK AND THE THEORY OF BROWNIAN MOTION [September, 

. \ U *■(■■• -1- 1 . R — tn 1 , 

(44) P{n | m; s + 1) = — P(n | m + 1 ; s) 4 — P{n \ m — 1 ; s), 

2 K 2 R 

which must be solved with the initial condition 

(45) P(n | m\ 0) = S(m, n). 

In the limit 


A 2 

" 0, T > 0, R > 00 , = Dy 

2 T 

ST = ty HA ^0, WA — > Xy 


1 


* y> 


the difference equation (44) is seen to go over formally into the differential 
equation 


(46) 


dP d(xP) d 2 P 
— y ~~ — ~ + D- 


dt 


dx 


dx 2 


which is Smoluchowski's equation (5) with F(x) = —x/yf. 

The discrete problem in a different form and in a different connection was 
first proposed and discussed by P. and T. Ehrenfest in 1907 [7], In the next 
section we shall discuss their original formulation. A fairly detailed treatment 
was given by Schrodinger and Kohlrausch in 1926 [8] and a brief exposition can 
be found in the review article of Wang and Uhlenbeck [l]. It seems that Schro- 
dinger and Kohlrausch were the first to point out the connection between the 
Ehrenfest model and Brownian motion of an elastically bound particle. How- 
ever, an explicit solution of (44) with the initial condition (45) was apparently 
not known. I have recently found such a solution using the matrix method de- 
scribed in Section 3 [9]. Instead of the infinite matrix of that section we must 
now consider the finite matrix 


(47) 


B = 



1 





0 

— 

0 

0 

0 • • 

0 


2R 

2 




1 

0 

~2R 

0 

0 • • 

0 


1 


3 



0 

1 

0 

— 

0 • • 

• 0 

• 

2R 

. . . 

2R 

1 

• 

0 

0 

• ' 

' * 

~2R 

0 


and the problem is again reduced to finding the eigenvalues X_.r, X-b+i, • • • , 
Xo, * * * , Xj?-i, Xu of B and matrices P and Q such that 
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(48) PQ = I 

and 


(49) 


B = P 




X-ij+i 

0 


\r-i 


\r 


Q. 


As before, P(n\ m; s ) is the ( m , n) element of B\ where 


(50) 


B* = P 


X_i2 


X— 22-j-j 


XjR_ 


Xij 


In order to perform the diagonalization (49) explicitly we start (following the 
procedure of Section 3) by trying to find the eigenvalues and the right eigenvec- 
tors of B . For this purpose we consider the system of linear equations 


( 51 ). 



= \Xq 
= \Xi 

= \x 2 


1 

— - X2R-1 = \X 2 R, 


and the auxiliary infinite system 


Xo + 





2 R 


xz 


= \x 0 

= TiXi 
= \X 2 


(52) 
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2R 


*2fl-l + 


2 R+ 1 
2R~ 
2R + 2 
2R 


%2R+1 = R 


#2fl+2 = X*2fi+1 


If we can find non-trivial solutions of (52) for which 
(53) x 2 r+i = 0 

we will have found solutions of (51). It will turn out that this procedure will 
again yield all eigenvalues and right eigenvectors. Multiplying the members of 
the equations of (52) by 1, z, z 2 , • • • , and adding, we obtain formally 



or, introducing, the abbreviation 

/(z) = X x kZ k , 
0 


z/(z) - ^/'(Z) + -^7'(z) = X/(z). 

We thus get the differential equation 

(54) /'(*) =2 

1 — z 2 

whose solution satisfying /(0) =#o is easily found to be 

(55) f(z) = x 0 (l - z) R ^( 1 + 2 )^< 1+x >. 

Since /(s) is analytic in the neighborhood of 2 = 0 the formal procedure can be 
justified. 

We now notice that if 

(56) X = — > j = - 1?, — R + 1, • • • , 0, • • • , R - 1, R, 

R 

f(z) is a polynomial of degree 2 i?, and hence # 222 + 1 = 0. The numbers (56) are 
thus seen to be eigenvalues of B and, since there are 2R+1 of them, we see that 
we have found all the eigenvalues. It also follows that the components of the 
right eigenvector belonging to the eigenvalue Xy —j/ R can be taken as 



1947] 


RANDOM WALK AND THE THEORY OF BROWNIAN MOTION 


383 


where the* C’s are defined by the identity 
(57) 


(1 - + z) B+i = £ciV. 


fc=0 


So far we have followed very closely the procedure described in Section 3. Sur- 
prisingly enough, we encounter unexpected difficulties in trying to carry out 
the analogy still further and determine by similar means the left eigenvectors. 

To find the matrix Q we resort to a different method. Let us first recall that 
P can be taken as the matrix whose jth column (for convenience columns and 
rows are numbered from — R to R) is 

1 

c? 

U2 


cm. 


Matrix Q must satisfy the equation 


P'Q' = /, 

which is an immediate consequence of the equation P() = J, and hence denoting 
by a-R , * * * , a 0 , • • • , cxr , the consecutive elements of thejth column of Q', we 
must have 


(58) 

From (58) it follows that 


]C C ( R+ r Oik = Kj> *0, 
k— — R 


r = — R, • • • , R. 


R +1 . s R + r R +r v-> R + r 

Z = 2^ d \J> r ) z = z 2^ C R+r a k = 2-/ a* 2^ CW* 


r=—R 


r=—R k=—R 

R 2R ns 

k——R 8=0 


k~—R r~-^R 


or, by virtue of (57), 

R 2# / J I z \ l 

z R+i = £ «»(1 - *)*~*(1 + z) B +* = (1 - z) 2B ) • 

k~-R 1=0 \1 — Z/ 

Thus 
(59) 


* *«+/ 


( 1 -*) 


2R 


^ /l + »V 

= 2^ai- R [- 1 

i=o \1 — z/ 
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so that 


1 - f 2 

z = and 1 — z = 

1 + t 1 + f 


In terms of f (59) assumes the form 
(- 1 ) B +* 

/ / / A I 


(i - r) B+3 '(i + r) B - 3 ' = E 


and since by (57) 


(i - r) B+/ (i + tf~* = E d" V, 


we obtain, by comparing coefficients of corresponding powers of f, 


or finally, 


(_ 1)»H ( _ fl 

“*- B — Cl • 


(- i) B+ * „(-,•> 
Cr+ ° • 


Formula (61) determines explicitly the elements of Q ' (and hence of ()), and it is 
now possible to write an explicit expression for P(n\m; s ). In fact, making use 
of (50), we obtain 

(62) P(n I m; s) = — — — L b C R+i C R+m . 

I K j=-R \K / 

In the limit 

A 2 1 

A — > 0, t — > 0, — = D, >y, st = t, wA — > xo , 

2 r Rt 


we have 


where 


/ > «a 

P(*b| ■ 

xi 


x 1 <mA< 


P(*o | *; f) = .. : e 'iVina— 2 i"). 

V2irZ)(l - e- 2 T<) 


( 63 ) 
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The proof is again made to depend on the continuity theorm for Fourier-Stieltjes 
transforms. 

The frequency function (63) was first discovered by Lord Raleigh [lO], Its 
connection with Brownian motion of an elastically bound particle, in the strongly 
overdamped case, was established by Smoluchowski who arrived at it quite 
independently. 

5. The Ehrenfest model. Irreversibility and recurrence. Imagine 2 R balls 
numbered consecutively from 1 to 2R f distributed in two boxes (I and II) so 
that at the beginning there are R+n, —R^n^R, balls in box I. We chose at 
random an integer between 1 and 2 R (all these integers are assumed to be equi- 
probable) and move the ball, whose number has been drawn from the box in 
which it is, to the other box. This process is then repeated s times and we ask 
for the probability Q(R+n\R+m; s ) that after s drawings there should be 
R+m balls in box I. 

A moment’s reflection will persuade one that this formulation (originally 
proposed by P. and T. Ehrenfest) [7 ] is equivalent to the random walk formu- 
lation of Section 4, if one interprets the excess over R of balls in box I as the dis- 
placement of the particle (A = 1). Thus 

Q(R + n | R + m; ) = P(n | m\ s ), 

where P(n\ m; s ) has the meaning of Section 4. 

In the present formulation we have a simple and convenient model of heat 
exchange between two isolated bodies of unequal temperatures. The tempera- 
tures are symbolized by the numbers of balls in the boxes and the heat exchange 
is not an orderly process, as in classical thermodynamics, but a random one like 
in the kinetic theory of matter. The realistic value of the model is greatly en- 
hanced by the fact that the average excess over R of the number of balls in box 
I, namely, the quantity 

R 

52 niP(n | m; s ) 

m=*—R 

can easily be shown to be equal to 

m ”0 - i) 

which in the limit R— >oo, 1/Rt— >y, sr = t , gives 

ne~ yt , 

or the Newton law of cooling. 

There are several proofs of (64) [l 1 ]. The most straightforward one, which 
is not however the simplest, is based on formula (62). 

The Ehrenfest model is also particularly suited for the discussion of a famous 
paradox which at the turn of this century nearly wrecked Boltzmann’s inspired 
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efforts to explain thermodynamics on the basis of kinetic theory. In classical 
thermodynamics the process of heat exchange of two isolated bodies of unequal 
temperatures is irreversible. On the other hand, if the bodies are treated as a 
dynamical system the famed "Wiederkehrsatz” of Poincare asserts that "almost 
every” state (except for a set of states which, when interpreted as p'oints in 
phase space, form a set of Lebesgue measure 0) of the system will be, to an arbi- 
trarily prescribed degree of accuracy, again approximately achieved. Thus, 
argued Zermelo, the irreversibility postulated in thermodynamics and the "re- 
currence” properties of dynamical systems are irreconcilable. Boltzmann then 
replied that the "Poincare cycles” (time intervals after which states "nearly 
recur” for the first time, — the word "nearly” requiring further specification) are 
so long compared to time intervals involved in ordinary experiences that pre- 
dictions based on classical thermodynamics can be fully trusted. This explana- 
tion, though correct in principle, was set forth in a manner which was not quite 
convincing and the controversy raged on. It was mainly through the efforts of 
Ehrenfest and Smoluchowski that the situation became completely clarified, 
and the irreversibility interpreted in a proper statistical manner. 

It will now be easy to discuss this explanation by appealing to the Ehrenfest 
model. Let P'(n\m; s ) denote the probability that after 5 drawings (the dura- 
tion of each drawing is r) R+m balls will be observed for the first time in box I 
if there were R+n balls in that box at the beginning. In particular, P'(n\ n; s) is 
the probability that the recurrence time of the state "»” (defined by the presence 
of R+n balls in box I) is st . One can then show that 

(65) JlP\n\n-,s) = 1, 

3=1 


or, in other words : each state is hound to recur with probability L This is the statis- 
tical analogue of the "Wiederkehrsatz.” One can show furthermore that, the 
mean recurrence time, namely, the quantity 


0 n = 2 STP'(n | n; s) 

3=1 


is equal to 

( 66 ) 


T 


( R -f- n) !(i£ — n ) ! 

(2 Wl 


2 2B . 


This is the statistical analogue of a "Poincare cycle,” and it tells us, roughly 
speaking, how long, on the average, one will have to wait for the state "«” to 
recur. 

If R+n and R — n differ considerably, 6 n is enormous. For example, if 
R = 10000, n = 10000, r = 1 second, we get 

0 = 2 20000 seconds (of the order of lO 6000 years!). 
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If on the other hand, R+n and R—n are nearly equal, 6 n is quite short. If in the 
above example we set n =0 we get (using Stirling’s formula) 

6 ~ 100\Zr seconds ^175 seconds. 

It was Smoluchowski who advanced the rule [12 ] that if one starts in a state 
with a long recurrence time the process will appear as irreversible. In our ex- 
ample if one starts with 20000 balls in one box and none in the other, one should 
observe, for a long time, an essentially irreversible flow of balls. On the other 
hand, if the mean recurrence time is short, there is no sense to speak about ir- 
reversibility. 

We now give the proofs of (65) and (66). We shall base our considerations 
on a formula which Professor Uhlenbeck used for similar purposes in some of his 
unpublished notes. The formula in question is: 

* a— 1 

(67) P(n | m\ s) = P'(n | s) + ^ P'(n | m\ k)P{m | nr, s — k ). 

*= i 

To convince oneself of the validity of this formula we divide all possible ways 
of reaching “m” from “ n ” in 5 steps into classes according to when “m” has been 
reached for the first time. We then observe that starting from “n” one can reach 
“m” in s steps in the following 5 mutually exclusive ways: 

(1) “m” is reached for the first time after 5 steps. 

(2) “ m ” is reached for the first time in 1 step and then, starting from u m” it is 
again reached in s— 1 steps. 

(3) “m” is reached for the first time in 2 steps and then, starting from “m”, 
it is reached again in s — 2 steps, and so forth. We note furthermore that 
the probability that “m v will be reached for the first time in k steps 
and then, starting from tt m, n it will be reached again in s — k steps, is 

(68) P'(n | m ; k)P(m | m; s — k ). 

This completes the proof of (67). 

It should be emphasized that the justification of using the product of prob- 
abilities in (68) rests upon the fact that in our process the past is independent of 
the future. In other words, once we know that the system starts, say, from 
its subsequent behavior is independent of the way in which “w” was reached in 
the first place. 

We introduce now the generating functions 

00 

(69) h{n | nr, z) — P( n I m > s ) z * 

3=1 

00 

(70) g(n \m\z) = Yj p> ( n \ m ‘< s ) z ‘> 

3=1 

and note that (67) is equivalent to 

h(n | m; z ) = g{n \m; z) + h(m | m; z)g(n | m\ z), 
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or 

(71) 

In particular, 

(72) 

and we also note that 


g(n | nr, z ) 


h(n | nr, z ) 

1 + h(m | nr, z) 


• h(n\ n; z) 1 

gn\n,z) 1 + A(w | w;z )“ \ + h{n\n-,z)’ 


(73) 


• dg(n | n ; z) 


dh(n \n; z) 


dz 


dz (1 + h(n | w; z) 2 

From the definition of g(n\ n; z), we obtain 


(74) 

(75) 


lim g(n | n; z) = I n > s ) 

Z~*l 8=1 

z—*i dz g=i 


It is from these formulas that we shall derive (65) and (66). We have, using (62) 


h(n | n\z) = 


(- 1 ) 


and since 

we obtain 
(76) 


1 = 


2 2R 

( — l^R+n R 


R+n R oo /A 7 \8 


-<-»>-</> 
^ R+ i ^ jR+n 


E „(-«)„ O') 


117/1 \ ^ l)^+ n ^ 1 <-»> (0 

1 + A(» z) = — — — 2^ : — Ci2 + ,-Ci2 +w . 

2 2B /— b . J 

1 2 

£ 


All terms in the sum on the right hand side of (76) are regular at z = 1 except the 
term corresponding to j = R> which has a simple pole at that point. Thus we can 
write 

(~ 1) B+ " _,( — n) _(B) 1 


1 + h(n | n; z) = p{z) H — — C 2 R Cr +u 


2™ 


1 - 2 


where p{z) is regular at 2 = 1. We see that 

lim (1 + h(n | n\ 2 )) = 

z-+l 


00 
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and hence, using (72) and (74) 

I>'(w| »&) = 1. 

8=1 

It is easy to see that 

(_!)*+» B) i (22?)! 

2 2B + 2 2 * (2? + »)!(2?- »)! 
and, denoting this expression by w, we have (for |z| >1) 
dg{n \ «; z) _ (1 - z) 2 jS>!(z) + to 

cfe [(1 — z)p(z) + 0 >] 2 

and hence 

dg(n\n;z) 1 

l im = • 

z~* i dz o) 

This together with (75) yields (66). 

The above considerations can be extended to more general processes. How- 
ever, Markoffian processes (* i.e ., processes for which (68) is valid) are still the 
only ones for which one can also calculate the “fluctuation” of the recurrence 
time, namely, the quantity 

(77) 2 AV(» I n; s) - 0*. 

8=1 

Without going into the details, let us mention that (77) can be calculated in 
terms of 

<f 2 g(w|w;z) 

Irni • 

z->i dz 2 

The fluctuation (77) gives us a measure of stability of the mean recurrence time 
inasmuch as it permits us to estimate how likely (or unlikely) it is to get a spec- 
ified deviation of the actual recurrence time from the mean. It may seem that 
since the generating function g{n\n; z) is known explictly it should be easy to 
get an explicit expression for P'(n\ n; s). This, however, is not the case. We have 
not succeeded in finding such an expression, except for P'(0| 0; s), and even then 
we had to use a different method. We shall give a brief description of this 
method. Let 

P{fl J Wl\ 1) = Pnm* 


P (ft j U] S) PnmiPmim% * * * Pm 9 -iiiy 

*»!,••• ,m, —i 


Then, 
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where the accent on the summation sign indicates that mf 9 £ n i j = 1, 2, • • • , s — 1. 
Now let 

if i = n 
if i n . 

Noticing that 

2 

€{ = 6j, 

we can write 

m ,, • • • ,m a —i 




where the summation is now extended over all m/. If B is the matrix 

(( pnm))y 


and B\ the matrix 


i^npnm^m)) > 


we see that 

(78) P'(n | n\ s) = ( n , n) element of BB\ B. 


We may note that Bi is obtained from B by crossing out the nth row and the 
nth column of the latter, and replacing them by a row and column consisting 
entirely of zeros. If Bi can be explicitly diagonalized, that is, written in the 
form 


[Mi 0 I 


where 


B i = Pi 


M2 

0 


Qh 


PiQi = I 

one can calculate P'(n\ n; s), explicitly using (78). 

We have applied this method to the Ehrenfest model, but only in the case 
when the middle (zeroth) row and column of B are replaced by a row and col- 
umn consisting entirely of zeros have we been able to diagonalize explicitly the 
resulting matrix B\, The diagonalization proceeds very much as in Section 4, 
but it has proved necessary to distinguish between the cases when R is even or 
odd. In case R is even, we were able to derive the formula 


P+1 



(?) 

R-l» 


(79) 


P'(0|0;s) = - 


2 2fl ~ 1 2 R 


s ^ 2, 
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where the summation is extended over all odd integers j between — R and R. 
The details of the derivation are somewhat tedious and will not be reproduced 
here. Formula (79) furnishes a partial solution to a question left open by Wang 
and Uhlenbeck [i]. 
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VIBRATION MODES OF TAPERED BEAMS 

EDMUND PINNEY, University of California 

The vibration modes of harmonically oscillating thin beams are obtained 
by solving the differential equation 

(1) (d 2 /dx 2 )(EId 2 y/dx 2 ) - pco 2 y = 0 

subject to certain boundary conditions. In this differential equation, x is the 
distance along the beam, y is the amplitude of the transverse vibration, E is 
Young’s modulus for the beam material, I is the cross-sectional moment of 
inertia of the beam, p is its linear density, and co is the circular frequency of vi- 
bration. 



